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Abstract 

This paper addresses the leader-follower flocking problem with a moving leader for networked Lagrange systems with parametric 
uncertainties under a proximity graph. Here a group of followers move cohesively with the moving leader to maintain connectivity and 
avoid collisions for all time and also eventually achieve velocity matching. In the proximity graph, the neighbor relationship is defined 
according to the relative distance between each pair of agents. Each follower is able to obtain information from only the neighbors in 
its proximity, involving only local interaction. We consider two cases: i) the leader moves with a constant velocity, and ii) the leader 
moves with a varying velocity. In the first case, a distributed continuous adaptive control algorithm accounting for unknown parameters is 
proposed in combination with a distributed continuous estimator for each follower. In the second case, a distributed discontinuous adaptive 
control algorithm and estimator are proposed. Then the algorithm is extended to be fully distributed with the introduction of gain adaptation 
laws. In all proposed algorithms, only one-hop neighbors’ information (e.g., the relative position and velocity measurements between the 
neighbors and the absolute position and velocity measurements) is required, and flocking is achieved as long as the connectivity and 
collision avoidance are ensured at the initial time and the control gains are designed properly. Numerical simulations are presented to 
illustrate the theoretical results. 
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1 Introduction 

A multi-agent system is defined as a collection of au¬ 
tonomous agents which are able to interact with each other 
or with their environments to solve problems that are diffi¬ 
cult or impossible for an individual agent. In a multi-agent 
system, the agents often act in a distributed manner to 
complete global tasks cooperatively with only local infor¬ 
mation from their neighbors so as to increase flexibility and 
robustness. 

The collective behavior can be observed in nature like flock 
of birds, swarm of insects, and school of fish. In [I], three 
heuristic rules are characterized for the flocking of multi¬ 
agent systems, namely, flock centering, collision avoidance 
and velocity matching. In [2], a flocking algorithm is intro- 
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duced for a group of agents when there is no leader. A theo¬ 
retical framework is proposed in [3] to address the flocking 
problem with a leader, which has a constant velocity and 
is a neighbor of all followers. Ref. [4] considers both cases 
where the leader has a constant and a varying velocity. When 
the leader has a constant velocity, [4] relaxes the constraint 
that the leader is a neighbor of all followers. However, in the 
case where the leader has a varying velocity, it still requires 
that the leader be a neighbor of all followers. Unfortunately, 
this is an unrealistic restriction on the distributed control de¬ 
sign, especially when the number of the followers becomes 
large. In [5], distributed control algorithms for swarm track¬ 
ing are studied via a variable structure approach, where the 
moving leader is a neighbor of only a subset of the followers. 
In [6], the flocking control and communication optimization 
problem is considered for multi-agent systems in a realistic 
communication environment and the desired separation dis¬ 
tances between neighboring agents is calculated in real time. 

Note that all above references focus on linear multi-agent 
systems with single- or double-integrator dynamics. How¬ 
ever, in reality, many physical systems are inherently non- 



linear and cannot be described by linear equations. Among 
the nonlinear systems, Lagrange models can be used to de¬ 
scribe a large class of physical systems of practical interests 
such as autonomous vehicles, walking robots, and rotation 
and translation of spacecraft formation flying. But due to the 
existence of nonlinear terms with parametric uncertainties, 
the algorithms for linear models cannot be directly used to 
solve the coordination problem for multi-agent systems with 
Lagrange dynamics. 

Recent results on distributed coordination of networked La¬ 
grange systems focus on the consensus without a leader 
[7-12], coordinated tracking with one leader [13-15], con¬ 
tainment control with multiple leaders [16-18], and flocking 
or swarming without or with a leader [19-21]. Ref. [19] pro¬ 
poses a control algorithm based on potential functions for 
networked Lagrange systems to achieve collision avoidance 
and velocity matching simultaneously in both time-delay and 
switching-topology scenarios. However, parametric uncer¬ 
tainties are not considered and there is no leader. Ref. [20] 
presents a region-based shape controller for a swarm of La¬ 
grange systems. By utilizing potential functions, the authors 
design a control scheme that can force multiple robots to 
move as a group inside a desired region with a common ve¬ 
locity while maintaining a minimum distance among them¬ 
selves. However, the algorithm relies on the strict assump¬ 
tion that all followers have access to the information of the 
desired region and the common velocity. A leader-follower 
swarm tracking framework is established in [21] in the pres¬ 
ence of multiple leaders. However, only a compromised re¬ 
sult can be obtained when the group dispersion, cohesion, 
and containment objectives are considered together. In the 
proposed algorithms, the variables of the estimators must be 
communicated among the followers. Furthermore, more in¬ 
formation is used in the controller design, for example, the 
second-order derivatives of the potential functions. 

In this paper we focus on the distributed leader-follower 
flocking problem with a moving leader for networked La¬ 
grange systems with unknown parameters under a proxim¬ 
ity graph defined according to the relative distance between 
each pair of agents. Here a group of followers move cohe¬ 
sively with the moving leader to maintain connectivity and 
avoid collisions for all time and also eventually achieve ve¬ 
locity matching. The leader can be a physical or virtual ve¬ 
hicle, which encapsulates the group trajectory. We consider 
two cases: i) the leader moves with a constant velocity, and 
ii) the leader moves with a varying velocity. In the first case, 
a distributed continuous adaptive control algorithm account¬ 
ing for unknown parameters and a distributed continuous 
estimator is proposed for each follower. In the second case, 
we first propose a distributed discontinuous adaptive con¬ 
trol algorithm and estimator, where we use a common con¬ 
trol gain that is sufficiently large for all followers. Hence 
the system is not completely distributed. We then improve 
the algorithm by further proposing gain adaption schemes to 
implement a fully distributed algorithm. In all proposed al¬ 
gorithms, only one-hop neighbors’ information is used, and 
flocking is achieved as long as the connectivity and colli¬ 


sion avoidance are ensured at the initial time and the con¬ 
trol gains are designed properly. Compared with the results 
in the existing literature, this paper has the following novel 
features. 

1) This paper considers each agent as a nonlinear Euler- 
Lagrange system with parametric uncertainties and is 
more realistic. While in [2,3,5,6], the agents’ dynamics 
are assumed to be single or double integrators. The results 
for single- or double-integrator dynamics are not appli¬ 
cable to Lagrange systems with parametric uncertainties. 

2) This paper considers the combination of flocking (consid¬ 
ering connectivity maintenance, collision avoidance, and 
velocity matching with a moving leader in the meantime) 
and the constraint that the leader’s information is avail¬ 
able to only the followers in its proximity. The above 
constraint introduces further complexities since not all 
followers know the leader’s velocity. Even for the case 
with single- or double-integrator agents, the problem is 
very challenging [5], not to mention the case of nonlinear 
Lagrange systems with parametric uncertainties. In con¬ 
trast, in [19], parametric uncertainties are not considered 
and there is no leader and in [20], it is assumed that the 
leader’s information is available to all followers (against 
the local interaction nature of the problem). 

3) To overcome the coexistence and coupling of the above 
mentioned challenges, in the current paper, we propose an 
adaptive control law in combination with a new distributed 
estimator for each follower. The novelty of the estimators 
is that the partial derivatives of the potential functions are 
integrated into the estimators. In [5,21], the variables of 
the estimators must be communicated between the neigh¬ 
bors. Eor the case of a moving leader with varying veloc¬ 
ity, the proposed algorithms in [5,14] require both one- 
hop and two-hop neighbors’ information. In contrast, in 
our proposed algorithms, only one-hop neighbors’ infor¬ 
mation (e.g., the relative position and velocity measure¬ 
ments between the neighbors and the absolute position 
and velocity measurements) is required. These measure¬ 
ments can be obtained by the sensing devices carried by 
the agents and hence the need for communication can be 
removed. Eurther, a fully distributed algorithm without 
global information is proposed in the current paper, while 
the results in [5,14,21] rely on some global information. 

Notations: Let 1„ denote the n x 1 column vector of all ones. 
Let Amin).) denote the minimum eigenvalue of a square real 
matrix with real eigenvalues. Let diag( 2 i,..., Zp) be the di¬ 
agonal matrix with diagonal entries zi to Zp. Eor symmetric 
square real matrices A and B with the same order, A > B 
or equivalently B < A (respectively, A> B or equivalently 
B < A) means that A — B is symmetric positive definite 
(respectively, semi-definite). Throughout the paper, we use 
II • II to denote the Euclidean norm, 0 to denote the Kro- 
necker product, and sgn( ) to denote the signum function de¬ 
fined componentwise. Eor a vector function f{t) : M i—>■ M™, 
it is said that f{t) € L; if (f^ ||/(T)|pdT)T < oo and 
f(t) G Loo if for each element of f(t), noted as fi(t). 
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supt>0 <oo,i=l,...,m. 

2 Background 

2.1 Lagrange Dynamics 

Suppose that there exist n + 1 agents (e.g., autonomous ve¬ 
hicles) consisting of one leader and n followers. The leader 
is labeled as agent 0 and the followers are labeled as agent 1 
to n. The n followers are described by Lagrange equations 
of the form [22] 

Mi{qi)qi + Ci[qi,qi)qi + gi[qi) = Ui, i = 1, ... ,n, 

where qi G is the vector of generalized coordinated^ 
Mi{qi) is the p x p symmetric inertia matrix, Ci^qijqiJqi 
is the Coriolis and centrifugal force, gi{qi) is the vector of 
gravitational force, and Ui is the control input. The dynamics 
of the Lagrange systems satisfy the following properties; 

(PI) There exist positive constants Lm such that 

kydp < Mi{qi) < %/p, < %||%|| and 

\\gi{qi)\\ < kg . 

(P2) Mi{qi) — 2Ci{qi, qi) is skew symmetric. 

(P3) The left-hand side of the Lagrange dynamics can be 
parameterized, i.e., Mi{qi)x + Ci{q^,qi)y + g^{qi) = 
Yi{qi,qi,x,y)9i, Va;,y G where Yi G is the 

regression matrix and di G is the unknown but 
constant parameter vector. 

In this paper, the leader can be a physical or virtual vehicle, 
which encapsulates the group trajectory. The leader’s posi¬ 
tion and velocity are denoted by, respectively, go S and 
go G E.P. 

2.2 Graph Theory 

With k agents in a team, a graph is used to characterize the 
interaction topology among the agents. A graph is a pair 
G = (y, E), where V = {1,..., fc} is the node set and E C 
y X y is the edge set. In a directed graph, an edge (g, i) G E 
means that node i can obtain information from node j but 
not necessarily vice versa. Here node j is a neighbor of 
node i. In an undirected graph {i,j) G E ^ (j, *) G E. 
A directed path in a directed graph is an ordered sequence 
of edges of the form (L, * 2 ), (* 2 , * 3 ), • ■ •, where ij G y. A 
subgraph of G is a graph whose node set and edge set are 
subsets of those of G. 

The adjacency matrix A = \aij\ G of the graph G 

is defined such that the edge weight = 1 if (j, i) G E 
and aij = 0 otherwise. For an undirected graph, = ap. 
The Laplacian matrix L = G associated with 


^ In the context of autonomous vehicles, qi denotes the position 
of agent i. 


A is defined as la = = —o-iji where 

i j. For an undirected graph, L is symmetric positive 
semi-definite [23]. 

In this paper, we assume that the neighbor relationship 
among the leader and the followers is based on their relative 
distance and hence the graph characterizing the interaction 
topology is a proximity graph. We also assume that the 
leader has no neighbor and its motion is not necessarily 
dependent on the followers. In particular, followers i and 
j are neighbors of each other if ||gi — g^jl < R and the 
leader is a neighbor of follower f if 11 g^ — go 11 < R, where 
R denotes the sensing radius of the agents. Let Gp be the 
proximity graph characterizing the interaction among the n 
followers with the associated Laplacian matrix Lp. Note 
that by definition Gp k undirected and hence Lp k sym¬ 
metric positive semi-definite. To simplify our analysis, we 
assign an orientation to an edge by considering one node 
the positive end of the edge and the other node the negative 
end of the edge. We recall that the n x N incidence matrix 
Dp = [dik] G of a graph is defined as [24] 

{ +1 if node i is the positive end of the edge £k, 

— 1 if node i is the negative end of the edge £k, 

0 otherwise. 

Then the Laplacian matrix of the graph can be denoted by 

Lp = DpD])). 

Let G be the directed graph characterizing the interaction 
among the leader and the n followers corresponding to 
Gp. Also let the edge weight Oio = 1 if the leader is 
a neighbor of follower i and om = 0 otherwise. Define 

A = diag(aio, ■ ■ •, «no)- Note that = A because am is 
either 1 or 0. Also define the leader-follower topology ma¬ 
trix associated with the graph G as H = Lp -\- A. It is 
obvious that H is symmetric positive semi-definite. Before 
moving on, we need the following lemmas. 

Lemma 2.1 [25] If the leader has directed paths to all 
followers, the matrix H is symmetric positive definite. 

Lemma 2.2 Let //“ and be the leader-follower topology 
matrix associated with, respectively the graph G° and G . 
If G is a subgraph of G , then //“ < H^. 

Proof : When G'* is a subgraph of G^, can be written as 
Rb _ pja where P is a positive semi-definite matrix. 
Therefore, it can be concluded that i/“ < H^. 

3 Main Results 

In this section, we study the leader-follower flocking prob¬ 
lem for networked Lagrange systems. The goal is to design 
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Ui for each follower to achieve the leader-follower flock¬ 
ing. That is, the followers move cohesively with the leader 
(connectivity maintenance) and avoid collisions for all time 
and eventually achieve velocity matching with the leader 
i\\qi{t) — (7o(i)|| 0) in the presence of unknown param¬ 

eters under only local interaction defined by the proximity 
graph. Before moving on, the following auxiliary variables 
are defined; 

Si = qi- Uj, qi = Qi- go, Vi = Vi- go, (2) 

where Vi is agent Ts estimate of the leader’s velocity to be 
designed later. Note that 

Si = qi- Vi. ( 3 ) 


3.1 Flocking when the leader has a constant velocity 

In this subsection, we consider the case where the leader has 
a constant velocity. We propose the following distributed 
control algorithm 

Ui =Ui + Yi{q^, qi, Vi, Vi)9^, ( 4 ) 

” ■ ” 

Ui=-'^-^-l'^a,j{t){q,-qj), (5) 

j=0 j=0 

” ' Qy.. ” ' 

-7'^a,j{t){q,-qj), (6) 

i=o j=o 

9i — ^iYi {c[i, qi, Vi, Vi^Si, ( 7 ) 

where (f) is the edge weight associated with the proximity 
graph G defined in Section II-B, Vij is the potential function 
between agents i and j to be designed, 9i is the estimate 
of the unknown but constant parameter 9i, Si is defined in 
(2), 7 is a positive constant, and is a symmetric positive- 
definite matrix representing the adaptation gain. 

Remark 3.1 Here Vi is the reference velocity, which intro¬ 
duces the partial derivatives of the potential functions in the 
estimators and it is a key to our problem. It is worthy men¬ 
tioning that (6) has a similar form of the reference velocity 
derivative proposed in [11 ], where the partial derivatives are 
replaced by the position synchronization term. Compared 
to the position and velocity synchronization problem con¬ 
sider in [11 [, here we study the flocking problem (connectiv¬ 
ity maintenance, collision avoidance, and velocity matching 
with a moving leader whose information is available to only 
the followers in its proximity). 

The potential function Vij is defined as follows (see [5]) 

(1) When ||<Zi(0) —gj(0)|| > R, Vij is a differentiable non¬ 
negative function of |\qi — qj \ \ satisfying the conditions: 
i) Vij = Vji achieves its unique minimum when ||gi — 
gjil is equal to the value dij, where dij < R. 


ii) Vij oo as ||gi - gjil -> 0. 

3(11^41) = 0 if lift - ftll > R- 

iv) Vii = c,i = 1,... ,n, where c is a positive constant. 
(2) When ||<7i(0) — (Zj(0)|| < R, Vij is defined as above 
except that condition iii) is replaced with the condition 
that Vij —> oo as ||gi — gjil —> R. 

The motivation of Vij is to maintain the initial connectivity 
pattern and to avoid collision. 

In the control algorithm (4)-(7), the term — i® 

used for collision avoidance and connectivity maintenance 
while the term — ®ii(f)(ft ~ ft ) fo'' velocity 

matching. The control algorithm (4)-(7) is distributed in the 
sense that each agent uses only its own position and velocity 
and the relative position and relative velocity between itself 
and its neighbors. 

Theorem 3.2 Suppose that at the initial time t = 0, the 
leader has directed paths to all followers and there is no 
collision among the agents. Using (A)-(l)for (1), the leader- 
follower flocking is achieved. 

Proof: By using the property (P3) of the Lagrange dynam¬ 
ics (1), it follows that Mi{qi)vi A- Cflqi,qi)vi + gflqi) = 
Yi{qi,qi,Vi,Vi)9i. Then using (1), (2) and (4), we have the 
following closed-loop system 

(ft ) Gi (qi, qi) Si — Ui Yi (qi, qi, Vi, Vi)9i, (8) 

where 9i = 9i — 9i. We first define the following non¬ 
negative function, which is a common Lyapunov function 
candidate used in the literature [11,12,17,26] with different 
definition of Si 

-i YL 1 ^ 

= 2 E ^*(9*)«* + 2 E r-'ft. (9) 

^ i=l ^ i=l 

The derivative of Vi is given as 

” 1 . - ; 

Vi + ^sjMflqfsi - 9jT-^9i\ 

n 

= '^sfui, (10) 

where we have used the property (P2) and (7) to obtain the 
last equality. To maintain the initial connectivity pattern and 
to avoid collision, we then define the following negative 
function by the combination of the potential functions 

- n n n 

j=i 
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Its derivative can be written as 


i, j, there exist positive constants 0 < -Rmin < R-max < R, 
such that 


i=l j=l 
n n 


dqi 


+ 9 /^) + E( 9 ' 

i=l 


rdV^o 


dqt 






2=1 


=EE^ 

2=1 i = l 
n n 


i=ii=i 


^q^ 

n 

E 

i=l 


<?0 




iO ^ 


dq^ 


t'T dVi 


iO 


dqi 


=EE 

i=l i=0 


iT 

’ 


% 


^dV, 


iO ^ 


9go 


where we have used Lemma 3.1 in [5] and the fact that 
lE “ ~ tE obtain the second equality, and have used 


dqi dq. 

•yn •J' dVi 
■^j — 1 ^0 dq. 

0 to obtain the third equality. 


the fact that EU Er=i EU ^ = 


Now consider the following Lyapunov function candidate 


V = Vi 


E 


Va Vj 


1^2. 


( 12 ) 


hiit) - q]it)\\ G [-Rmin,-Rmax], ^ |k»(0) - <7^(0) || < R, 
lk»(i) - %(i)ll G [i?min, {n - l)i?max], Otherwise. 

(15) 

Hence, we can conclude that the graph G(0) is a subgraph 
of the graph G{t) for all t > 0. It follows from Lemma 2.2 
that H{0) < H{t). Therefore, we can get from (14) that 

V <-lf[H{0)(^Ip]i (16) 

Since in G(0) the leader has directed paths to all followers, 
it follows from Lemma 2.1 that H{Q) is symmetric positive 
definite. Integrating both sides of (16), we can obtain that q G 
L 2 . Note that q^ is constant and hence bounded. Combining 
the above boundedness arguments we can get from (2) that 
qi, qi, Vi G Loo. Since Vij is continuously differentiable, we 
can get from (15) that G Loo. From (5) and (6), we 
have Ui,Vi G Loo. Then from (8) and the property (PI), it 
can be concluded that Si G Loo. By noting that Si = iji — Vi, 
it follows that iji € Loo • Overall, we have qi G Loo fl ^2 
and (ji G Loo. From Barbalat’s lemma [27], we can conclude 
that qi —> 0, that is, ||gi — goU —>■ 0 asymptotically. ■ 


Then the derivative of V is given as 


^=E 


n 

sfwi + E 

2=1 


V, v^ 


EE 

i=l j=0 


dV^ 
dqi ' 


Since the leader’s velocity q^ is constant, we have Vi = Vi = 
Ui according to (5) and (6). It follows that 


n n n 

i=l i=l j=0 

n n 

= -EE iaij{t)qf {qi - qj), 

i=l j=0 


(13) 


where we have used (3) to obtain the first equality and have 
used (5) and qi — qj = qi — qj to obtain the second equality. 
Eq. (13) can be written in a compact form as 


Remark 3.3 Ai it can be seen, by using the control law (4)- 
{!) for (1), the followers can track the leader with the same 
velocity while avoiding collision and maintaining the initial 
connectivity. Note that with our algorithm design, as long as 
at the initial time the connectivity is maintained and there 
is no collision, the connectivity maintenance and collision 
avoidance are ensured for all time. The proposed algorithm 
is continuous and accounts for unknown parameters of the 
agents’ dynamics. 

3.2 Flocking when the leader has a varying velocity 

In this subsection, we consider the case when the leader 
moves with a varying velocity. In this case, the problem is 
more difficult to tackle since all followers must track the 
leader while the leader’s velocity changes over time and the 
leader is a neighbor of only a subset of the followers in 
its proximity. In the remainder of the paper, we have the 
following assumption on the leader. 


V = —iiE[H{t)®Ij,% (14) 

where g is a column stack vector of qi, i = 1,... ,n, and 
H (t) is the leader-follower topology matrix at time t defined 
in Section II-B. Note that H{t) is symmetric positive semi- 
definite. It follows that V is negative semi-definite. There¬ 
fore, from IG > 0 and IG < 0, it can be concluded that V is 
bounded and thus Si,0i,Vi, Vij G Loo. Since Vij is bounded, 
it is guaranteed that there is no collision and no edge in the 
graph G(0) will be lost. In other words, for any pair of agents 


Assumption 3.4 The leader’s velocity q^ and acceleration 
qQ are both bounded. It is assumed that ||1„ 0 go|| < ai, 
where ai is a positive constant. 

We propose the following distributed control algorithm 

Ui =u^ + Yi{qi,q^,Vi,Vi)0i, (17) 

”91/-- ” 

Mi = - « E “ «sgn(si), 

j=o i=o 

( 18 ) 
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dY- ■ 

Vi=-^ - a^a„(t)sgn(ft - q^), (19) 

i=o j=o 

i.Qi') Qij ^i’l ^ 2)^27 ( 20 ) 

where a is a positive constant, and aij{t), Vij, Si and are 
defined as in Section III-A. 


< - a||[D|^(t) (g)/p]g|| - a\\[A{t) Ip]q\\ 

+ ||1« ® g'oll • II 9 II - a||s|| + ||ln ® goll • llsll 

where s and q are, respectively, the column stack vectors of 
all Sj’s and g^’s, i = 1,..., n, and we have used the fact that 
II • II < II • 111 for any vector to obtain the inequality. Since 
i|ln ® goll < O';, we have 


Theorem 3.5 Suppose that at the initial time f = 0, the 
leader has directed paths to all followers and there is no 
collision among the agents. Using for (1), if a > 


maxjCTj, 


is achieved. 






then the leader-follower flocking 


Proof: Consider the same Lyapunov function candidate V 
defined in (12). Note that using (17) for (1), where Ui is 
given by (18), both (8) and (10) still hold. The derivative of 
V is given as 


^ = E 


n 

sf Mi + E 
2=1 


~T 
V. U 


+E E 9 ? 

i=l j=0 


dV^ 

dq^ ' 


Note from (18) and (19) that 


Vi = Ui-\- asgn(sj). 


Also note from (2) that Vi = Vi — g'o- ft follows that 


L<-a|| 


[79p(f) 0 Ip] 
[A(f) O Ip] 


7ll +cri||g|| 


a s + cr; S 


'\ 


[DF{t)<S>Ip] [A(f)(g)Jp] 


[D'pit) C) Ip] 
[A{t) 0 Ip] 


+ ai\\q\\ - (a-cri)||s|| 

= - o:^Jq'^]H{t)^Ip]q-\-ai\]q]] - (a - cri)||s 
< - ay^Xmin[IIit)]]]q]] ai]]q]] - {a - crOlkl 


where we have used the equation DF(t)Dp{t) + A^(f) = 
LF{t)-\-A{t) — II{t) to obtain the second equality and have 
used the fact that 77(f) is positive semi-definite to obtain 
the last inequality. Note that at the initial time f = 0, the 
leader has directed paths to all followers. We can get from 
Lemma 2.1 that 77(0) is symmetric positive definite and 
thus Ainin[77(0)] > 0. Since a > max{cri, ^=i==}, 

"Y ^min (If)J 

we have at time 7 = 0 that. 


n n 

V = ^ sf M* + ^ [ui + asgn(s0 - go] 
2=1 2=1 


n n 


+EE^r 


dqi ' 


( 21 ) 


Note from (3) that Vi = qi — Si. Therefore, it follows that 


V{f) < -[as/\mu.[H(f))] - ai)M < 0. (23) 

Note that although the control input Ui is discontinuous, the 
positions of the agents are continuous and 77(7) changes 
according to the relative positions among the agents. If 
77(7) changes at some time, there exists 7i > 0 such that, 
77(7) = 77(0) for 7 S [0,7i) and 77(7i) f 77(0). Therefore, 
we have 


n n 

L = E + asgn(sj) - go] - ^ sf [asgn(s,) - go] 
2 = 1 2 = 1 


n n 


+EE^^ 


dqi 


( 22 ) 


Substituting Ui defined in (18) to (22), we can get 

V = - aflDFit) O 7p]sgn([79|l(7) O 7p]g) 

- ag'^[A(7) O 7p]sgn([A(7) O 7p]g) - q'^iln O go) 

- a||s||i + s^(l„ O go) 

= - a||[79|)(7) (g)7p]g||i - a||[A(7) O 7p]g||i 

- g^(lri 0 go) - q;||s||i + s^(l„ 0 go) 


L(7) < -(aVAmi„[77(0)] - cri)||g|| < 0, 7 g[0,7i), 

which implies that for 7 G [0, 7i), Vij G Lgo for all pairs of 
qi{t) and qj (7). Since Vij is continuous, we can conclude that 
Vij G Loo when 7 = 7i. From the definition of Vij, it follows 
that there is no collision and also no edge in the graph 0(0) 
will be lost for 7 G [0,7i]. Therefore, the only possibility 
that 77 (7) changes at 7 = 7i is that, some edges are added in 
the graph. It implies that G(0) is a subgraph of G(7i). We 
can then get from Lemma 2.2 that 77(0) < 77(7i) and thus 
Amin[77(0)] < Amin[77(7i)]. Therefore, at time 7 = 7i, 


V{t) < - (aA/Ainin[77(7i)] - cr/)||g|| 
< - (aA/Ainin[77(0)] - crz)||g||. 


^ Since at the initial time t = 0, the leader has directed paths to 
all followers, we can get from Lemma 2.1 that Amin [77(0)1 > 0, 
and thus the term , ^ is well defined. 

V^min[M(0)] 


Following the same argument, if 77 (7) changes at t = ti> 7i, 
7 = 2,..., we can get that Vij will always be bounded. Hence 
there is no collision and no edge in the graph G(0) will be 
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lost. This in turn implies that for all t G [ti, fi+i), G(0) is a 
subgraph of Gi{t). It thus follows that for all t G [ti, fi+i), 
H{0) < H,{t) and A„,in[Tf(0)] < That is, 

a > , ^ for all t > 0. Hence 

(23) holds for all f > 0. We then can get that Si, 0i, 
Vi G Loo - Since V{t) > 0 and V(t) < 0, it is concluded that 


Voo = linit-j-oo V(t) G [0, V (0)] exists. Thus, integrating 
both sides of (23), we can obtain that q G Li. Note from 
Assumption 3.4 that both go and go are bounded. Combin¬ 
ing the above boundedness arguments, we can get from ( 2 ) 
that gi, (ji, Vi G Lqo- Following the same statements from 
the proof of Theorem 3.2, we can conclude that G Loo. 
From (18) and (19), we have Ui, Vi G Loo. Then from the 
closed-loop dynamics for each follower and (PI), we have 
Si € Loo. By noting that Si = iji — Vi, it follows that qi € Loo 
and thus qi G Loo. Overall, we have qi G LooH^Bi and 
qi G Loo. From Barbalat’s lemma [27], we can conclude 
that (ji -G 0. That is, — goU —> 0 asymptotically. ■ 


Remark 3.6 Ai it can be seen, the proposed algorithm (17)- 
(20) guarantees that the leader-follower flocking is achieved 
when the leader has a varying velocity in the presence of un¬ 
known parameters. Therefore, despite the hard restrictions 
such as nonlinear Lagrange dynamics, unknown models’ pa¬ 
rameters, and the existence of a moving leader with a vary¬ 
ing velocity, the control input (17)-(20) solves the flocking 
problem. 


Remark 3.7 Due to the existence of the signum function, 
the closed-loop dynamics of i\) using (17) is discontinuous. 
The solution should be investigated in terms of differential 
inclusions. Note that the signum function is measurable and 
locally essentially bounded. Therefore, from the nonsmooth 
analysis in [28], the Filippov solutions for the closed-loop 
dynamics always exist. Because the Lyapunov function can¬ 
didate in the proof of Theorem 3.5 is continuously differ¬ 
entiable and the set-valued Lie derivative of the Lyapunov 
function is a singleton at the discontinuous point, the proof 
of Theorem 3.5 still holds. To avoid symbol redundancy, we 
do not use the differential inclusions in the proof. It is wor¬ 
thy mentioning that the drawback of the signum function is 
the potential chattering behavior. In practice, a simple and 
useful way to avoid the discontinuous of the control action 
is to replace the signum function by a smooth function such 
as tanh(-), with which satisfactory performance can still be 
achieved, as confirmed in our later simulation. 


3.3 Fully distributed flocking when the leader has a vary¬ 
ing velocity 


In the previous section, all agents use common gains in their 
control inputs and the gains should be above certain bounds 
which are actually determined by the global information 
(Aniin[Ff(0)],(T;). Therefore, the algorithm (17)-(20) is not 
fully distributed. In this section, the previous algorithm is 
extended to be fully distributed and gain adaptation laws are 
introduced. Here the control algorithm for each follower is 
designed as 


Ui 

— ^ 5 

qi,Vr,Vi)0i, 



(24) 

Ui 

“ La,. 

i=o 

n 

— aij Uij 

j=0 

(f)sgn(g, - 

- 9j) - 

■ ftsgn(si) 






(25) 

Vi 

II 

n 

— aij Uij 

(f)sgn(g, - 

- 9j), 

(26) 

Otij 

= luaij{f)\\q 

i — 7o 1 , 



(27) 

ft 

CO 

iM 

II 




(28) 

k 


Qit 



(29) 


where aij{f), Vij, Si and F^ are defined in Section III-A, 
hi, hi are positive constants, and aij{t), flflf) are varying 
gains with ay(0),/3i(0) > 0. 


Remark 3.9 The gain adaptation laws (27) and (28) are 
inspired by recent results on adaptive gain design for multi¬ 
agent systems [18, 29, 30]. The intuition behind (27) and 
(28) is that the control gains in Theorem 3.5 must be above 
certain lower bounds. Under (27) and (28), as long as the 
velocity matching is not achieved, the gains will always in¬ 
crease, eventually rendering the agents to achieve velocity 
matching. The drawback of (27) and (28) is that the 1-norm 
of the signals will result in the non-stop increase of the gains 
in the presence of disturbances or measurement errors. Here 
we just show the theoretical analysis in the ideal situation. 
In practice, one alteration is to introduce a small bound 
on the right hand sides (RHSs) of (27) and (28). When the 
RHSs of (27) and (28) are within some given bound, 
and j3i stops increasing. 


Remark 3.8 The case of a leader with a constant velocity is 
a special case of a leader with a varying velocity. Hence we 
can also use the algorithm (17)-(20)/or the leader-follower 
flocking problem when the leader has a constant velocity. 
However, the algorithm (4)-(7) is continuous. In contrast, 
the algorithm (17)-(20) is discontinuous and may cause the 
chattering issues. Therefore, when the leader has a constant 
velocity, the algorithm (4)-(7) is more favorable than the 
algorithm (17)-(20). 


Theorem 3.10 Suppose that at the initial time t = 0, the 
leader has directed paths to all followers and there is no col¬ 
lision among the agents. Using (24)-(31)/or (1), the leader- 
follower flocking is achieved. 


Proof: Define C 3 = Y.7=i + 

Er=i where a and 


are chosen such that a > 




and (3 > ai. The 
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derivative of V 3 is given as 


n n ^ 

1^3 = XI 9 - «) 11 * - 111 

i=ii=i^ 

n n 

+ “ «)ll'?*l|l + “ ^)l|Si||l 

n n ^ 

=EE^ a^j{t){a^j - a){qi - qjf sgn{q, - qj) 

i=i i=i^ 
n 

+ E ®*o(f)(aio - a)(% - 9o)^sgn(gi - (jo) 

i^l 

n 

+ ^(A - /^)|ki||l 

n n 

=EE a,j{t){aij - a)qfsgn{qi - qj) 

i=ij=i 

n n 

+ '^aioit){aio-a)q'[sgn{q,-qo) + '^{l3i-l3)\\si\\i 

n n 

=EE atj it) (o^^j - ot)qJ sgn{q,-qj) + {Pi-l3)\\s,\\i]. 

i=l j=0 

(30) 

Now we introduce the following Lyapunov function candi¬ 
date 




where Vi is defined in (9) and V 2 is defined in (11). Follow¬ 
ing the proof of Theorem 3.5, the derivative of V is given as 


iL li iL n Ota 

i^l i^l i^l j^O 

n n 

= E + E + /?*sgn(s*) - 9o] 

2^1 2^1 

n n 

-EEAf+ f 3 

i=l j=o 

n n 

= E + Asgn(s*) - 9o] - X snAsgn(sO “ 9o] 


n n 

EEAf 

(=1 i=o 


V^3, 


(31) 


where we have used Vi = qi — Si to obtain the third equality. 
Substituting (25) and (30) to (31) and doing some manipu¬ 
lation, we can get 

V <- a\\[D]i{t) (g) Ip]q\ \ - a||[A(f) (g) Jp]g|| 


where q and s are, respectively, column stack vectors of qi 
and Si, i = 1,... ,n. Since ||1„ (g) go|| < ai, we have 


V < - a^yXn,in[H{t)]\\q\ \ +ai\\q\\- /3||s|| -f cri||s||. 

Again there exists fi > 0 such that, H{t) = H{0) for 
t G [0,fi). Since at time f = 0 the parameters a and P 
satisfy a > , = and /3 > cti, we have 


V{t) < -iaytX^i^[H{0)] - ai)\\q\\ < 0, fe[0,fi). 

Similar to the statements in the proof of Theorem 3.5, it 
can be proved that for t G [ 0 ,fi], Vij is bounded for all i, 
j and there is no collision and also no edge in the graph 
G(0) will be lost. It can also be proved that V(t) <0 for 
all t > 0. Then it can be concluded that qi G Loo H and 
qi G Loo. Hence from Barbalat’s lemma, we conclude that 
lift ~ <?oll 0 asymptotically. 

Remark 3.11 /n the fully distributed algorithm (24)-(27) 
adaptive gain schemes are introduced. This algorithm guar¬ 
antees that the leader-follower flocking is achieved when the 
leader has a varying velocity in the presence of unknown 
parameters and there is no requirement of any global infor¬ 
mation. Therefore, despite the hard restrictions described in 
Section II-B and the existence of a moving leader with a 
varying velocity, the fully distributed control input (24)-(27) 
solves the flocking problem. 

Remark 3.12 In [5], the distributed flocking problem with 
a moving leader has been solved for multi-agent systems 
with single or double integrators. Here in this paper, we ad¬ 
dress the problem for networked nonlinear Lagrange systems 
with parametric uncertainties, which is more challenging. 
The algorithms in [5] cannot deal with nonlinear Lagrange 
dynamics and account for fully distributed gain design. Be¬ 
sides, the algorithms in [5] rely on both one-hop and two- 
hop neighbors’ information, while only one-hop neighbors’ 
information is required in our proposed algorithms. In [14] 
a distributed coordinated tracking problem is studied for 
Lagrange systems with parametric uncertainties. However, 
the algorithms in [14 ] cannot deal with the nonlinear flock¬ 
ing behavior or account for fully distributed gain design but 
still requires the two-hop neighbors’ information. 

4 Simulation 

In this section, numerical simulation results are given to il¬ 
lustrate the effectiveness of the theoretical results obtained in 
Section III. We consider the formation flying of four space¬ 
craft, where the formation control is based on the relative 
translation with respect to a virtual point or chief spacecraft 
following a circular reference orbit [31]. The relative dy¬ 
namics of the ith spacecraft is considered in a chief-fixed. 



LVLH rotating frame, which can be written as 


.. o • 2 , ruifieiro+Xi) 

rriiXi - 2minoyi - niinQXi H- 3 - 

miUi + 2minoXi - miriQy^ H- 3 — = Uiy, 

rriifieZi 

’IXliZi 3 — 


chosen as 7 = 0.04 and = 5 / 3 , i = 1,..., 4. Fig. 1 shows 
the trajectories of the leader and the followers. Clearly, all 
imyLe followers move cohesively with the leader without colliding 

^2 “ with each other. Fig. 2 shows the velocity of the followers 

° and the leader. It can be seen that the velocities of the fol¬ 

lowers converge to that of the leader and all agents move 
with the same velocity. There are two new edges added to 
the graph and no edge is lost. 


where rrii is the unknown but constant mass of the *th space¬ 
craft, /ie is the gravitational constant of Earth, tq is the radius 
of the chief, no = y /is the angular velocity of the ref- 


A 


erence orbit, qi = [xi^ yi, Zif is the position of the zth space¬ 
craft in the LVLH frame, and Ui = [uix,Uiy,UizY' is the 


control input. Let Mi = mils, Ci = m 

/ -Mt -I- \ 

I n ^ \ 


/ 0 -2no 0\ 
2no 0 
0 0 


0 

V 



gi = 


-nlyi + 



, then the relative 


translation dynamics can be written in the form of (1), with 
the unknown parameter 9i = mi. 


Fig. 1. The trajectories of the followers and the leader in the first 
case. The leader is represented as a square while the followers are 
represented as circles. An edge between two followers denotes that 
the two are neighbors, and an arrow from the leader to a follower 
denotes that the leader is a neighbor of the follower. 


In the simulations, we let mj = 30 -F 5i kg, tq = 7000 km, 
and R = 200 m. The initial positions of the leader and the 
four spacecraft are, respectively, go(0) = [—80, 200, 0]^m, 
qi(0) = [-80, 90, 0]^m, 92(0) = [100, 90, 0]^m, 93(0) = 
[100, —100, 0]^m, and 94(0) = [—80, —100, Oj^m. The ini¬ 
tial velocities are assumed to be zero. The unique mini- 
mums of Vij are assumed to be 80 m. Lollowing [5], when 
||9i(0) — 94(0)11 > 200, the potential functions are defined 
whose partial derivatives satisfy 


dV^ 

dqi 


0 , 


II9* - 9^11 > 200; 


(gi-9j)cos(0.l7r(||qi-gj-||-80)) 
250\\qi-qi\\ 
(gi-9j)(lki-9j 11-80) 

250||9-g,|F 


, 80 < lift-94II < 200; 
11% - 94II < 80. 



Fig. 2. The velocity errors between the followers and the leader 
using (4)-(7). 


When ||9i(0) — 94(0)1] < 200, the potential functions are 
defined whose partial derivatives satisfy 


dqi 


(gi-9j)(lk — 9j 11-80) 

25119-94 11 ( 119-94 11 - 200)2 > 

(9 —94)(I|9 — 94 II- 8 O) 

250||9.-9fiF 


80 < 11 %-94 II < 200 ; 
11% - 94II < 80. 


In the first case, we simulate the case where the leader 
has a constant velocity under the control algorithm (4)- 
(7). The constant velocity of the leader is assumed to be 
9o = [0.1, 0.1,0.2]^. The initial values for the estimates of 
the leader’s velocity are all zero. The control parameter is 


In the second case, we simulate the case where the 
leader has a varying velocity under the control algo¬ 
rithm (17)-(20). The initial states of the followers are 
chosen as above and the leader’s velocity is chosen as 
9 o(f) = [0.1 sin(||f), 0.1 cos(l^f), 0.2]"^. The initial posi¬ 
tion of the leader is chosen as 9o(0) = [—80, 200,0]^. The 
control parameters are chosen as a = 0.04, and F^ = 5 / 3 , 
i = 1,... ,4. We use tanh(lOOO-) to replace the function 
sgn(-). Fig. 3 shows the trajectories of the followers and the 
leader. The agents maintain the initial connectivity while 
avoiding collisions. Fig. 4 shows that each follower eventu¬ 
ally moves with the same velocity as the leader. Similarly, 
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there are two new edges added to the graph and no edge is 
lost. 



Fig. 3. The trajectories of the followers and the leader in the 
second case. 



t/S 

Fig. 4. The velocity errors between the followers and the leader 
using (17)-(20). 

In the third case, we simulate the case where the leader has a 
varying velocity under the fully distributed control algorithm 
(24)-(31). Here the initial states and the leader’s trajectory 
are chosen as the second case. The control parameter is 
chosen as = 5 / 3 , 7 ii = 72 ^ = 0.003, i = 1,..., 4. Fig. 
5 shows the trajectories while Fig. 6 shows the velocities of 
the followers and the leader. It can be seen that the leader¬ 
following flocking is achieved and there is no edge added 
or lost. 

5 CONCLUSIONS 

In this paper, the distributed leader-follower flocking prob¬ 
lem has been studied. The agents’ models are described by 
Lagrange dynamics with unknown but constant parameters. 
Two cases for the leader have been considered; i) the leader 
has a constant velocity, and ii) the leader has a varying ve¬ 
locity. In both cases the leader is a neighbor of only a group 
of followers and the followers interact with only their neigh¬ 
bors defined by a proximity graph. In the second case we 



Fig. 5. The trajectories of the followers and the leader in the third 
case. 



t/S 

Fig. 6. The velocity errors between the followers and the leader 
using (24)-(31). 

also relaxed the assumption of global information for param¬ 
eter determination and proposed a fully distributed control 
algorithm. All proposed control algorithms require only one- 
hop neighbors’ information and have been shown to achieve 
connectivity maintenance, collision avoidance, and velocity 
matching with a moving leader. Numerical simulations have 
also been presented to illustrate the theoretical results. 
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